Papers with Deep pre-trained contextualized encoders
A matter of framing: The impact of linguistic formalism on probing results (2020.emnlp-main)
Copied to clipboard
| Challenge: | Pre-trained contextualized encoders have had a major impact on the field of natural language processing. |
| Approach: | They conduct an in-depth cross-formalism layer probing study in role semantics to investigate the linguistic knowledge implicitly learned by pre-trained contextualized encoders. |
| Outcome: | The proposed model outperforms pre-trained models on a range of downstream tasks. |